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A  DISPLAY  FOR  DEMONSTRATING  ANALOG  COMPUTATIONS 
WITH  RANDOM  PULSE  SEQUENCES 


I.   Introduction 

This  display,  shown  in  Figure  1,  is  a  demonstration  of  a  new 
way  of  electrically  representing  numbers.   The  big  advantage  of  this 
particular  representation  is  that  the  numbers  represented  are  continuous 
as  in  an  analog  computer  and  not  discrete  as  in  a  digital  computer.   How- 
ever, the  basic  operations  of  addition,  subtraction,  multiplication, 
division,  and  squaring  are  performed  using  digital  circuits.   In  short, 
analog  computations  are  done  with  digital  circuits  giving  us  the  advan- 
tages of  continuous  variables  and  fast  realiable  cheap  digital  circuits. 

The  Random  Pulse  Sequences  (RPSs)  mentioned  in  the  title 
characterize  the  way  numbers  are  represented  in  this  display.  More 
fully  we  are  dealing  with  clocked  RPSs  (CRPSs).   A  drawing  of  a  CRPS  with 
respect  to  the  clock  pulses  would  show  a  sequence  of  pulses  randomly 
spaced  in  aribitrary  clock  periods.   The  magnitude  of  the  number  repre- 
sented would  be  the  probability  that  a  pulse  will  occur  in  some  clock 
period  which  is  e  jual  to  the  normalized  average  number  of  pulses  that 
occur  during  some  ample  time.   In  this  display  then,  the  magnitude  of  a 
number  is  thought  of  as  either  the  probability  of  a  pulse  occurring  or 
the  normalized  average  number  of  pulses  or  both. 


The  development  of  this  display  is  an  extension  of  the  work  of 
C.  Afuso  to  include  signed  numbers  and  was  guided  by  Prof.  W.  J.  Poppelbaum. 


Figure  1.   Display  for  Demonstrating  Analog  Computations 
with  Random  Pulse  Sequences 
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One  property  of  this  representation  of  numbers  is  that,  if  two 
independent  CRPSs  are  fed  into  an  AND  gate,  the'  output  will  also  be  a 
CRPS.   Its  probability  of  having  a  pulse  is  the  probability  that  both  in- 
puts have  a  pulse  and  the  number  thus  represented  is  equal  to  the  product 
of  the  numbers  represented  by  the  input  CRPSs.   Because  the  probabilities 
of  pulses  occurring  during  adjacent  clock  periods  of  the  same  CRPS  are 
independent,  a  second  property  is  that  a  CRPS  can  be  delayed  one  clock 
period  with  a  flip  flop.   If  the  original  and  the  delayed  CRPSs  are  then 
fed  into  an  AND  gate,  the  number  represented  at  its  output  is  the  square 
of  the  number  represented  by  the  original  sequence.   To  see  a  third 
property,  consider  the  circuitry  in  an  analog  computer  to  switch  one  of 
two  desired  analog  signals  onto  some  bus.   In  a  CRPS  system,  if  the  two 
analog  quantities  are  CRPS-A  and  CRPS-B,  then  the  Boolean  expression  for 
the  bus  would  be  SA  V  SB  where  S  is  a  digital  signal  used  to  switch  A  or 
B  onto  the  bus.   The  cost  of  performing  these  properties  in  a  system 
according  to  O.E.M.  December  1967  prices  could  be  less  than  80  cents  to 
multiply,  $2.80  to  square,  and  $1.20  to  digitally  select  one  of  two 
analog  signals.   In  addition  to  low  cost,  a  CRPS  system  has  the  speed  and 
realibility  of  integrated  circuits . 

II.   Generating  a  CRPS 

This  section  appears  before  that  of  the  system  design  so  that 
any  readers  who  might  still  be  confused  about  the  exact  nature  of  CRPSs 
will  have  the  opportunity  to  clarify  their  understanding. 

The  following  drawing,  Figure  2,  illustrates  how  a  CRPS  is 
generated  and  how  some  of  the  signals  look.   The  noise  source  is  a  pn 
junction  reversed  biased  into  plasma  breakdown.   This  noise  signal  is 
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Figure  2.   Generating  a  Clocked  Random  Pulse  Sequence  (CRPS). 
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fed  into  a  variable  level  threshold  detector.   The  output  of  this 
detector  is  a  logical  signal  which  is  a  "1"  only  "when  the  noise  voltage 
exceeds  the  threshold  voltage.   As  the  threshold  is  changed,  the 
probability  that  the  detector's  output  will  be  a  "1"  is  changed.   This 
signal  is  then  sampled  with  clock  pulses  to  obtain  a  signal  whose  pulses, 
when  they  occur,  occur  during  a  clock  period.   Thus  as  the  threshold  is 
changed,  the  probability  that  a  pulse  will  occur  during  some  arbitrary 
clock  period  is  changed. 

Because  the  relationship  between  the  threshold  voltage  and 
probability  is  not  linear  and  because  the  noise  characteristics  are  sen- 
sitive to  the  bias  voltage  and  temperature,  a  smore  elaborate  circuit, 
shown  in  Figure  3?  is  used  which  utilizes  feedback.   In  this  circuit  the 
SM535^+  transistor's  collector  to  base  junction  is  used  to  generate  the 
noise.   The  100K  resistor  and  +2^v  supply  act  like  a  current  source  and 
provide  the  bias  current  necessary  to  achieve  plasma  breakdown.   The 
710  linear  integrated  comparator  circuit  acts  as  the  threshold  device 
and  the  SN7^7^N  acts  as  the  clocked  sampling  unit.   Its  output  pulses 
are  fed  back  to  the  709  linear  integrated  operational  amplifier  circuit. 
This  has  as  its  other  input  the  input  voltage  threshold.   The  7^9  is  wired 
to  integrate  the  error  between  the  average  voltage  of  the  pulses  and  the 
input  voltage.   The  output  error  plus  bias  voltage  increases  if  there  are 
too  many  pulses.   This  error  plus  bias  signal  is  fed  to  an  RC  circuit  to 
eliminate  any  noise  on  that  signal.   A  few  millivolts  error  on  this 
signal  can  mean  a  large  error  in  the  number  of  pulses.   The  output  of 
the  RC  averaging  circuit  determines  the  threshold  for  the  710  circuit. 
If  this  threshold  signal  increases  fewer  noise  pulses  will  be  larger  than 
the  threshold.   This  results  in  fewer  output  pulses  which  will  in  turn 
reduce  the  threshold  voltage.   Thus  errors  in  the  system  tend  to  be  reduced, 
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III.   System  Design  and  Operation 

The  view  a  person  using  the  display  has'  is  shown  in  Figure  1 
and  the  inside  of  the  display  is  shown  in  Figure  h.      The  system  design 
is  shown  in  Figure  5-   To  explain  the  interactions  of  the  system  components, 
a  typical  computation  will  be  explained. 

After  the  power  has  been  connected  and  turned  on,  the  system  is 
calibrated.   This  can  be  done  best  by  setting  the  operation  code  to  the 
A  operation  and  adjusting  the  A  input  magnitude  potentiometer  (pot)  so 
that  the  count  on  the  Clocked  Result  banana  jack  is  as  close  to  500KHz 
as  possible.   The  calibration  pot  is  then  ajusted  so  that  the  result 
meter  reads  exactly  0.5- 

The  operation  switches  are  not  set  for  any  desired  operation, 
the  input  magnitude  pots  are  adjusted  so  that  the  A  and  B  meters  indi- 
cate the  desired  magnitude  for  the  A  and  B  inputs,  and  the  signs  of  the 
A  and  B  inputs  are  set  as  desired.   The  input  pots  adjust  the  thresholds 
of  the  CRPS  converters  as  discussed  in  Section  II.   The  CRPSs  coming 
out  of  the  converter  go  two  places .   First ,  they  are  buffered  and  then 
averaged  by  the  A  and  B  meters.   Second,  they  go  into  the  Computing 
Element  where  they  are  operated  on  according  to  the  operation  specified 
by  the  sign  and  operation  switches .   The  outputs  of  the  Computing  Element 
consist  of  a  sign  signal  which  drives  the  sign  bulb  and  the  Result  CRPS 
which  is  buffered  and  averaged  by  the  Result  meter.   The  Result  CRPS  is 
also  clocked  and  sent  to  the  Clocked  Result  banana  jack. 

Typically  then,  the  operator  sets  the  input  operation  and  sign 
switches,  adjusts  the  input  magnitude  pots  while  watching  the  A  and  B 
meters,  and  reads  his  result  from  the  Result  meter  and  sign  bulb. 
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Figure  h.      Physical  Layout  of  the  Display 
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IV.   Computing  Element 

The  computing  element  as  a  whole  consists  of  six  large  sections 
of  gating  which  form  Boolean  expressions  for  the  operation  to  be  performed, 
the  J  and  IC  inputs  to  the  output  (Result)  flip-flop,  the  UP  and  DOWN 
signals  for  the  up-down  counter,  and  the  correct  sign  for  the  output.   There 
is  also  a  sign  flip-flop  which  indicates  the  relative  magnitudes  of  the 
A  and  B  inputs  during  subtraction. 

In  order  to  add  two  CRPSs  we  literally  force  the  result  CRPS 
to  have  as  many  pulses  as  the  sum  of  the  input  pulses .   This  is  done  by 
applying  a  pulse  to  the  output  whenever  input-A  or  input-B  has  a  pulse. 
The  need  for  the  up-down  counter  arises  whenever  both  A  and  B  have  pulses. 
In  this  case  the  counter  is  increased  one  count.   Then,  whenever  neither 
A  nor  B  has  a  pulse  and  the  counter  is  not  empty,  the  counter  is  counted 
down  one  count  and  a  pulse  applied  to  the  output.   The  equations  to  do 
this  are:   J*  =  A  v  B,  }£   =  ABZ,  UP+  =  ABW,  D0WN+  =  ABZ  where  Z(W)  indi- 
cates all  zeros  (ones)  in  the  counter  when  it  is  a  "1". 

To  subtract  CRPC-B  from  CRPS-A  we  delete  a  pulse  in  the  A 
sequence  for  each  pulse  that  occurs  in  the  B  sequence.   A  problem  arises 
when  the  B  sequence  has  a  pulse  and  the  A  sequence  does  not.   In  this 
case  we  increase  the  counter  one  count.   Then,  for  each  A  pulse  for  "which 
there  is  not  a  B  pulse,  the  counter  is  decreased  one  count  unless  it  is 
already  empty.   In  that  case  a  pulse  is  applied  to  the  output.   The 
equations  for  a  simple  subtraction  are:   J  =  ABZ,  }C   =  A  v  B,  UP  =  ABW, 
DOWN  =  ABZ.   If  the  B  sequence  is  larger  in  magnitude  than  the  A  sequence, 
then  the  counter  will  continually,  on  the  average,  increase  its  count. 
Eventually  it  will  become  full  (W  =  "1").   When  this  happens  one  can  commute 
the  inputs  and  change  the  sign  of  the  Result. 
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Division  is  slightly  more  complicated  to  understand  but  as 
easily  performed  as  addition  and  subtraction.   The  number  of  pulses  in 
the  average  period  of  two  pulses  of  a  CRPS  is  equal  to  the  reciprocal  of 
the  sequences  value.   To  multiply  this  quantity  times  a  dividend  sequence 
we  output  this  quantity  for  each  pulse  in  the  devidend  sequence.   Mathemati- 
cally the  input  A  and  B  are  characterized  by  P.  =  f./f   and  P^  =  f-o/f 
—     —  AA'c       BB'c 

where  P  is  probability,  f  is  average  frequency,  and  f  is  clock  frequency. 

The  reciprocal  of  P  is  f  /f  .   If  this  number  of  pulses  is  applied  to 

the  output  for  each  A  pulse,  the  output  sequence  has  f  =  f  f  /f  pulses. 

Normalizing  we  get  P^  =  f^/f  =  f./f.,  which  is  correct  for  division.   In 

R    R'  c    A'  B 

actual  practice  for  each  A  pulse  all  the  pulses  in  the  next  B  period  are 

applied  to  the  output.   Again  a  counter  is  necessary.   In  this  case  it 

keeps  track  of  the  number  of  A  pulses  which  have  occurred  for  which  no  B 

periods  haA/e  occurred.   The  equations  for  simple  division  are:   JJ"  =  BZ  v  AB, 

R 

K^"  =  ABZ,  UP"  =  ABW,  DOWNr  =  ABZ.   Because  of  overflow  problems,  the  A 

input  sequence  is  prescaled  by  .1  in  the  display. 

Multiplication  is  the  easiest  of  the  operations  because  a 

simple  AND  gate  will  form  the  product  of  its  inputs  if  all  the  inputs 

are  independent.   Thus,  PA  =  fA/f  and  P^  =  f_/f  yield  P^  =  f.f^/f  2. 

'   A    A'  c      B    B'  c        R    A  B'  c 

2   2 
If  P  is  a  delayed  version  of  P  ,  then  P  =  f  /f   to  give  a  squaring 

operation. 

In  the  diagram  that  follows,  Figure  6,  most  of  the  circuitry 

is  necessary  to  form  the  expressions  J  ,  K_,  UP  ,  DOWN  from  A,  B,  Z,  and 

W  and  to  form  J  =  0  J^,  K=  0  K±,  UP  =  0  UP1,  and  DOWN  =  0  DOWN1. 
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V.  Control  and  Timing 

There  are  several  major  timing  considerations.  First,  the 
sampling  unit  in  the  converter  and  the  output  flip-flop  in  the  Computing 
Element  are  driven  by  the  same  clock.   Consequently,  the  maximum  path 
delay  from  the  sampling  unit  to  the  flip-flop  must  be  less  than  one  clock 
period.   Secondly,  the  sampling  unit  triggers  on  the  positive  clock  trans- 
ition and  the  flip-flop  and  counter  on  the  negative  transition.   This 
means  that  the  clock  pulse  must  be  as  narrow  as  possible  and  its  period 
must  be  at  least  as  great  as  the  maximum  path  delay.   The  display  uses 
a  1MHz  clock  frequency  with  the  clock  pulse  width  about  40ns.   This  is 
more  than  adequate  to  eliminate  any  timing  difficulties. 

The  remainder  of  the  circuits  in  this  unit  generate  a  sequence 
with  a  magnitude  of  .1,  buffer  the  signals  going  to  the  meters,  and  clock 
the  Result  sequence  so  that  it  can  be  counter.  Figure  7  illustrates 
these  circuits. 

VI.  Sampling  CRPSs  and  Accuracy 

Because  we  can  square  by  delaying  a  sequence  one  clock  period 
and  multiplying  the  original  times  the  delayed  sequence,  we  know  that 
adjacent  clock  periods  are  independent  samples  of  the  random  variable  of 
the  noise  being  greater  than  the  threshold  voltage.   If  we  count,  over 
a  period  of  time,  T,  the  number  of  clock  periods  which  have  a  "1",  the 
resulting  distribution  is  binomial  because  each  clock  period  is  essentially 
an  independent  trial.  When  the  number  of  samples  n  =  Tf  is  large,  the 
distribution  becomes  Gaussian  as  shown  in  Figure  8. 

The  mean  is  proportional  to  the  clock  frequency  and  the  length 
of  time  sampled,  i.e.  proportional  to  n.   The  standard  deviation  is 
proportional  to  vn,  so  accuracy  increases  as  the  vn. 
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When  the  pulses  of  a  CRPS  are  averaged  to  get  an  average  voltage 
to  represent  the  magnitude  of  the  CRPS,  pulse  shape  becomes  critical. 
Consequently  each  meter  has  to  be  adjusted  to  compensate  for  its  driver 
and  meter  resistance  by  a  series  pot.  Because  of  power  supply  changes 
and  fluctuations,  it  is  also  necessary  to  have  a  well-regulated  reference 
which  can  be  adjusted  when  the  power  supply  voltage  is  different  from 
one  use  to  the  next.   These  circuits  are  shown  in  Figure  9  5  and  the  power 
supply  in  Figure  10. 
VII.   Conclusions 

Analog  computations  with  Random  Pulse  Sequence  seems  to  have 
a  great  deal  of  potential  where  variable  accuracy  is  around  1%   and 
variable  bandwidth  is  in  the  range  of  10  to  100  ms  or  larger.   This  degree 
of  ability  is  easily  apparent  in  the  demonstration  display. 

The  display  however  is  not  without  some  problem  areas.   Foremost 
is  the  effects  on  the  distributions.   In  the  case  of  division  the 
situation  is  poor  enough  to  prevent  its  output  from  being  used  in  a 
squaring  or  another  division  operation.   This  does  not  mean  that  the 
system  is  not  useful.   Most  computations  do  not  necessitate  many  divisions 
and  rarely  a  series  of  divisions.   Expressions  can  usually  be  arranged 
to  minimize  and  separate  divisions. 

An  alternative  number  representation  that  looks  attractive  is 
a  ratio  representation  where  a  rational  number  is  characterized  by  a 
sign-magnitude  numerator  and  a  sign-magnitude  denominator  which  means  that 
one  number  is  represented  by  four  wires.   Division  in  this  representation 
is  accomplished  by  interchanging  the  rolls  of  the  numerator  and  denominator. 
Consequently,  in  a  large  system  where  many  operations  are  being  performed, 
no  distributional  problems  would  arise  due  to  the  division  operation.  At 
the  output,  or  where  the  value  of  any  signal  is  needed,  the  method  of 
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di vision  used  in  this  display  could  be  used.   If  a  large  system  were  to 
be  designed,  it  should  include  both  scaling  and  non-scaling  addition.   In 
a  system  -which  doesn't  have  scaling,  overflows  can  be  a  problem.   In  a 
system  which  doesn't  have  non-scaling  addition,  the  magnitudes  of  variables 
may,  after  many  operations,  get  lost  in  the  variance  of  the  random 
signals. 

The  second  area  for  improvement  is  the  logical  design  of  the 
Computing  Element.  The  circuits  necessary  to  do  this  could  be  reduced 
in  several  ways.  First,  by  making  use  of  the  fact  that  A  +  B  can  be  per- 


formed by  forming  A  -  B  and  wiring  the  up-down  counter  to  always  perform 
subtraction,  i.e.  UP  =  AB,  DOWN  A  AB.   A  close  look  at  B/A  shows  that 
up  is  AB  and  down  is  AB.   In  general  then,  it  should  be  possible  to  wire 
the  up-down  counter  to  work  the  same  way  for  all  operations  that  use  it 
and  just  put  the  correct  A  and  B  expressions  into  it.   This  would  eliminate 
some  of  the  gating  necessary  to  form  the  UP  and  DOWN  signals  as  presently 
designed. 

Secondly,  the  logic  can  be  reduced  by  using  a  D-type  sampling 
flip-flop.   This  requires  one  input  which  is  clocked  to  the  output  with 
each  clock  pulse.   In  this  case,  logic  is  necessary  to  form  only  the  D 
expression  and  not  the  J  and  K^  expressions  as  is  presently  being  done. 

Thirdly,  when  two  numbers  of  the  same  sign  and  equal  magnitudes 
are  subtracted,  the  error  due  to  the  finite  size  (3  stages)  of  the  u- 
down  counter  becomes  quite  evident.   A  four  or  five  stage  counter  would 
substantially  reduce  this  error. 
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